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(54) Data processing method and apparatus 

(57) A data processing method for registering meta- 
data In binary data loads data to be processed including 
binary data, and meta-data to be appended to the 
binary data. If it Is determined that the loaded meta-data 
has a correct format, it is checked if existing meta-data 
Is present in the loaded data to be processed. If existing 
meta-data is present in the data to be processed, new 
meta-data is formed on the basis of the existing meta- 
data included in the data to be processed, and the 
loaded meta-data. The new meta-data is connected to 
the end of the binary data in the data to be processed, 
and the connected data is output as a file. 
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Description 

FIELD OF THE INVENTION 

[0001] The present Invention relates to a data 
processing method and apparatus, which process 
binary data and meta-data, and a storage medium. 

BACKGROUND OF THE INVENTION 

[0002] Meta-data is "data pertaining to data", and Is 
used as data that explains binary data such as image 
data, audio data, and the like. However, when binary 
data and corresponding meta-data are present as inde- 
pendent files, the user must manage the binary data 
and meta-data at the same time upon moving or copy- 
ing files, resulting in Inconvenience. 
[0003] In general, in order to facilitate management 
of binary data and meta-data, various methods that 
describe binary data and meta-data have been pro- 
posed. Such conventional techniques can be catego- 
rized into methods of defining new binary formats, and 
methods that manage those data using databases. 
[0004] As examples of the method of defining a new 
binary format, Tiff, Exif, Flashpix, and the like are known 
as new image formats. Fig. 21 shows the concept of a 
format In which meta-data is embedded in binary data. 
As binary data, for example, image data is used. As 
shown in Fig. 21 , a field for describing meta-data is nor- 
mally allocated in the header field of an image, and the 
user describes meta-data in that field. By describing 
meta-data in such way, data can be easily searched and 
classified. Since binary data includes meta-data, they 
can be managed by a single file, thus allowing relatively 
easy file management. 

[0005] A method of managing binary data and 
meta-data using a database will be explained below. 
Fig. 22 shows the concept of the method of managing 
binary data and meta-data using a database. The 
method of managing binary data and meta-data, which 
are present as independent files, using a database or 
the like, as shown in Fig. 22, is also prevalent In this 
case, existing binary data can be used by an existing 
application without any modifications. 
[0006] However, the method of defining a new for- 
mat that describes meta-data, and the method of man- 
aging meta-data using a database suffer their 
respective problems. 

[0007] When a new format that describes meta- 
data is defined, existing binary data must be converted 
into the new format, and meta-data must be described 
in that new format. Furthermore, in order to search 
binary data using the meta-data in the new format, an 
application compatible to the new format Is required. 
That is, in order to describe and use meta-data, a large 
number of steps and dedicated environment are 
required. Also, in order to process binary data In such 
new format (e.g., to reproduce an image if the binary 



data is image data), an application compatible to that 
format is required, and an existing application cannot 
cope with this situation. 

[0008] In addition, since the description method of 

5 meta-data is uniquely determined in the new format, a 
new search routine must be created to create an appli- 
cation that uses meta-data in the new format. Further- 
more, in order to describe meta-data in a new field, the 
specifications of the format must be changed. 

10 [0009] On the other hand, when binary data and 
meta-data are simultaneously managed using a data- 
base, meta-data can be neither registered nor used if 
database software is not available. Also, in order to dis- 
play registered meta-data, dedicated software is 

is required. Furthermore, when binary data is read out 
from the database, meta-data does not come with it, 
i.e., binary data without meta-data is formed. 
[001 0] Furthermore, in both the aforementioned two 
methods, upon changing or modifying meta-data, the 

20 following problem is posed. That is, when meta-data 
has already been present, if new meta-data is regis- 
tered, it is automatically overwritten on old one. There- 
fore, if the user wants to leave the existing meta-data, 
he or she must acquire this existing meta-data, and 

25 must add and update this meta-data. 

[0011] When meta-data are provided in different 
languages (natural languages), meta-data translated 
into a desired language must be created, and must be 
added or replace the existing data. When the existing 

30 data are replaced, they are lost On the other hand, 
when the translated meta-data are added, identical con- 
tents are displayed in different languages, resulting In 
Inconvenience. 

[0012] Furthermore, new binary data may be cre- 
ss ated by synthesizing a plurality of binary data, in such 
case, the aforementioned method of defining a new for- 
mat that can describe meta-data, and method of man- 
aging meta-data using a database suffer the following 
problems. 

40 [0013] Upon synthesizing two data in the new for- 
mat that describes meta-data, meta-data included in 
these two data are lost or only one meta-data is left. 
[0014] When a database is used, if binary data for 
which meta-data have already been registered are syn- 

45 thesized, new meta-data must be added, and one of a 
plurality of synthesized meta-data must be registered as 
that for synthesized binary data, resulting in very trou- 
blesome operations. 

[0015] Conventionally, in order to describe a rela- 
50 tionshlp among a plurality of binary data, various meth- 
ods are used. For example, as an example of describing 
the relationship among a plurality of binary data, a dig- 
ital album using a plurality of still images and moving 
images, and a multimedia document such as a home 
55 page using Image data and audio data are known. 
[0016] In such multimedia document including mov- 
ing image data, still image data, text data, and the like, 
the relationship among a plurality of binary data is 
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described using a link format file (Fig. 23) that describes 
the locations of a plurality of still and moving Images, a 
file (Rg. 24) with a format unique to an application, or 
the like. For example, the link format file is written in, 
e.g., HTML, and its contents can be confirmed using, 5 
e.g., a browser. In a file with a format unique to an appli- 
cation, its contents are confirmed using the correspond- 
ing application. 

[0017] However, both these methods suffer a prob- 
lem of how to associate a multimedia document that 10 
manages a plurality of binary data to that binary data. 
That is, in case of a format unique to an application, a 
very large, single file including a plurality of binary data 
is formed, and it becomes difficult to independently han- 
dle data. On the other hand, when the relationship is 
described in a link format, e.g., In HTML, the relation- 
ship among a plurality of binary file cannot be obtained 
if no HTML fife is available, and binary data and its man- 
agement data cannot often be managed systematically. 

SUMMARY OF THE INVENTION 

[0018] The present invention has been made in 
consideration of the aforementioned problems that per- 
tain to the description and search of meta-data, and has 
as its object to allow registration of meta-data in binary 
data without any influences on existing applications. 
[0019] It is another object of the present invention to 
provide binary data registered with meta-data in a for- 
mat that can be processed by an existing application. 
[0020] It is still another object of the present inven- 
tion to save existing meta-data If it Is already present, 
and to allow additional registration of new meta-data. 
[0021] It is still another object of the present Inven- 
tion to allow presentation of meta-data history when a 
plurality of meta-data are registered. 
[0022] It is still another object of the present inven- 
tion to allow use of existing tools for a data description 
language by describing meta-data using a general data 
description language, so as to facilitate development of 
a compatible application. 

[0023] It is still another object of the present inven- 
tion to extract meta-data from binary data in which the 
meta-data Is described, so as to be able to use it in 
processes such as search, reference, change, and the 
like. 

[0024] It is still another object of the present inven- 
tion to allow effective use of existing meta-data upon 
describing new meta-data in binary data, which is gen- 
erated by synthesizing a plurality of binary data. 
[0025] It is still another object of the present inven- 
tion to allow selective description of existing meta-data 
in synthesized binary data depending on purposes, 
when meta-data have already been registered in corre- 
spondence with a plurality of binary data to be synthe- 
sized. 

[0026] It is still another object of the present inven- 
tion to allow description of only data contained in all 



meta-data, when meta-data have already been regis- 
tered In correspondence with a plurality of binary data to 
be synthesized. 

[0027] It is still another object of the present inven- 
tion to allow description of the relationship among a plu- 
rality of binary data in each of binary data as meta-data, 
and to obviate the need for use of an HTML file or album 
file to describe the relationship among a plurality of 
binary data. 

[0028] It is still another object of the present inven- 
tion to allow search for a plurality of associated binary 
data based on single binary data by providing meta- 
data of respective binary data to each binary data. 
[0029] Other features and advantages of the 
present invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures thereof. 



20 BRIEF DESCRIPTION OF THE DRAWINGS 
[0030] 

Fig. 1 is a block diagram showing the arrangement 
25 of a data processing apparatus according to the 
first embodiment of the present invention; 
Rg. 2 is a flow chart for explaining a meta-data reg- 
istration process according to the first embodiment; 
Rg. 3 is a flow chart for explaining details of a meta- 
30 data connection process according to the first 
embodiment; 

Rg. 4 is a view showing the concepts of replace, 
add, and cancel processes in the meta-data regis- 
tration process according to the first embodiment; 
35 Rg. 5 Is a view for explaining the registration proc- 
ess of new meta-data to binary data in which a plu- 
rality of meta-data are registered; 
Fig. 6 is a flow chart showing the discrimina- 
tion/extraction sequence of the registered meta- 
40 data according to the second embodiment of the 
present invention; 

Rg. 7 is a flow chart for explaining details of a meta- 
data discrimination process according to the sec- 
ond embodiment; 
45 Fig. 8 shows an example of the data format of 
binary data in which XML data is registered as 
meta-data; 

Rg. 9 is a flow chart for explaining a meta-data reg- 
istration process according to the third embodiment 
so of the present invention; 

Rg. 10 is a view for explaining the registered state 
of meta-data in binary data according to the third 
embodiment; 

Rg. 11 is a flow chart for explaining the sequence 
55 for synthesizing a plurality of data according to the 
third embodiment; 

Rg. 12 is a view for explaining the operations in 
steps S1303 and S1304; 
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Rg. 13 Is a view for explaining the process In step 
S1305; 

Fig. 14 Is a flow chart for explaining a meta-data 
registration process according to the fourth embod- 
iment of the present invention; 
Fig. 15 is a flow chart showing a Joint process of 
meta-data to n binary data according to the fourth 
embodiment; 

Rg. 1 6 shows an example of meta-data which is 
used in the fourth embodiment, and describes loca- 
tion information of binary data; 
Rg. 17 is a view showing the joint state of meta- 
data to binary data according to the fourth embodi- 
ment; 

Rg. 1 8 shows the relationship among binary data to 
which meta-data are respectively joined in the 
fourth embodiment; 

Rg. 19 is a flow chart showing the analysis 
sequence of data to be processed according to the 
fifth embodiment of the present invention; 
Fig. 20 is a flow chart showing the analysis method 
in meta-data according to the fifth embodiment; 
Rg. 21 shows the format of binary data In which 
meta-data is embedded; 

Fig. 22 shows the concept of a method of managing 
binary data and meta-data using a database; 
Rg. 23 shows a method of describing the locations 
of binary data in a general link format; and 
Rg. 24 shows a method of describing the relation- 
ship among binary data In a general format unique 
to an application. 

[0031] The accompanying drawings, which are 
incorporated In and constitute a part of the specification, 
illustrate embodiments of the invention and, together 
with the description* serve to explain the principles of 
the invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0032] Preferred embodiments of the present inven- 
tion will now be described in detail in accordance with 
the accompanying drawings. 

[Rrst Embodiment] 

[0033] Rg. 1 is a block diagram showing the 
arrangement of a data processing apparatus according 
to the first embodiment. Referring to Rg. 1 , reference 
numeral 100 denotes a reader, which reads an image 
using, e.g., a scanner device. Reference numeral 101 
denotes an input unit which is used by the user to Input 
an Instruction and data, and includes a keyboard and 
pointing device. Reference numeral 1 02 denotes a stor- 
age unit which stores binary data and meta-data. A hard 
disk is normally as the storage unit 102. Reference 
numeral 103 denotes a display which displays binary 



data stored in the storage unit 1 02, and Image data read 
by the reader 1 00. A CRT or liquid crystal display device 
is normally used as the display 103. 
[0034] Reference numeral 104 denotes a CPU 

5 which Is involved In all processes of the aforementioned 
building components, and a ROM 105 and RAM 106 
provide programs, data, or a work area required for 
such processes to the CPU 1 04. Note that a control pro- 
gram that implements the processing sequence of this 

w embodiment (to be described later with reference to Rg. 
2) is also stored in the ROM 105. Of course, that control 
program may be stored in the storage unit 102, and may 
be loaded onto the RAM 1 06 upon being executed by 
the CPU 104. 

15 [0035] Note that the data processing apparatus of 
the first embodiment has various other building compo- 
nents in addition to those described above, but they do 
not constitute the gist of the present invention, and a 
detailed description thereof will be omitted. 

20 [0036] A process for registering meta-data in binary 
data In the data processing apparatus with the afore- 
mentioned arrangement will be explained below. Rg. 2 
is a flow chart for explaining the meta-data registration 
process according to this embodiment 

25 [0037] Referring to Fig. 2, data to be processed 
designated by the user is loaded onto a memory (RAM 
106) in step S301. For example, the data is designated 
by inputting a file name of the desired data to be proc- 
essed at the keyboard, or pointing to an Icon of the cor- 

30 responding binary data using the pointing device (e.g., a 
mouse). In step S302, an XML file which is designated 
by the user and describes meta-data Is loaded onto the 
memory (RAM 106). This XML file is also designated by 
Inputting a file name at the keyboard or pointing to the 

35 corresponding icon by the pointing device (e.g., a 
mouse). 

[0038] It is checked in step S303 if the XML file that 
describes meta-data is XML data in a correct format. 
The correct format Is discriminated by checking If the 

40 description format of an XML file is satisfied (e.g., if the 
opening and closing parentheses of tags correctly 
match, if a tag assignment format is correct, and so 
forth). Note that it is also checked if XML data is correct 
as well as if it has a correct format Whether or not XML 

45 data is correct can be determined by checking, e.g., if 
XML data is described in accordance with a schema 
such as DTD (Document Type Definition) or the like. 
[0039] If the XML file is not XML data in the correct 
format, the flow advances to step S308. In step S308, 

so an XML data error is displayed on the display 1 03, thus 
ending this process. 

[0040] On the other hand, if the XML tile is XML 
data In the correct format, the flow advances to step 
S304. It is checked In step S304 if meta-data described 
55 in XML has already been registered in the data to be 
processed loaded in step S301 . Note that a method of 
checking if meta-data is registered will be described 
later with reference to Rg. 7 in the second embodiment. 
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[0041 ] If It is determined in step S304 that no meta- 
data is registered, the flow advances to step S306. In 
step S306, meta-data is registered by connecting that 
meta-data to the end of the binary data loaded onto the 
memory in step S301. After that, the data to be proc- 
essed registered with the meta-data is output in step 
S307, thus ending the process. Note that data having a 
data structure 40 shown in Rg. 4 is stored as one file in 
the storage unit 102 upon outputting data in step S307 
(in this case, the data loaded in step S301 corresponds 
to binary data composed of a header 41 and data 42, 
and the meta-data designated in step S302 corre- 
sponds to meta-data 43). 

[0042] On the other hand, if it is determined that the 
meta-data has already been registered, the flow 
advances to step S305. In step S305, one of "add", 
"replace", and "cancel" is selected as a process for that 
meta-data, and the selected process is done. Details of 
step S305 will be explained below with reference to the 
flow chart shown in Fig. 3. 

[0043] Fig. 3 is a flow chart showing details of the 
meta-data connection process according to this embod- 
iment Note that this process is executed when the user 
instructs one of "add", "replace", and "cancer via the 
input unit 1 01 . This instruction is implemented by gener- 
ating a key input corresponding to each of these proc- 
esses at the keyboard, or pointing of a function button 
using the pointing device. 

[0044] If it is determined in step S401 that neither 
"add" nor "replace" are instructed, i.e., "cancel" of meta- 
data registration is instructed, the process shown in Fig. 
3 ends, and the flow advances to step S307 In Fig. 2. On 
the other hand, If an Instruction for registering meta- 
data by "replacing" or "adding" it is detected, the flow 
advances to step S402. It Is checked in step S402 if 
"replace" or "add" is instructed. 
[0045] If a meta-data "replace" instruction is 
detected, the flow advances to step S403 to delete the 
existing meta data. The flow then advances to step 
S404 to register new meta-data by connecting it to the 
end of binary data, thus ending the processing. On the 
other hand, if a meta-data "add" instruction is detected 
in step S402, the flow jumps to step S404 while skipping 
step S403. In step S404, meta-data is registered by 
connecting it to the end of binary data, thus ending the 
processing. 

[0046] Upon completion of the processing (step 
S305) shown in Fig. 3, the flow advances to step S307 
in Fig. 2, and the obtained binary data is output. As a 
result, data having a data structure (to be described 
later with reference to Fig. 4) is stored as one file in the 
storage unit 102. 

[0047] Rg. 4 shows the concepts of replace, add, 
and cancel processes in the aforementioned meta-data 
registration process. For example, when registration of 
new meta-data by "replace" is instructed with respect to 
binary data 40 in which meta-data has already been 
registered, meta-data 43 is deleted (step S403), and 



new meta-data 44 Is connected to the end of the binary 
data (S404), thus generating new data 40a. 
[0048] On the other hand, when registration of new 
meta-data 44 by "add" is Instructed, the new meta-data 

5 44 is registered at the end of the data (step S404) to 
generate data 40b. On the other hand, when "cancel" Is 
instructed, no new meta-data 44 is connected. 
[0049] As described above, according to the meta- 
data registration process of this embodiment, one or a 

10 plurality of meta-data (43 and/or 44) written in an XML 
file are connected to the end of binary data (composed 
of the header 41 and data 42). In this manner, meta- 
data can be registered without any influences on other 
applications. More specifically, since information in the 

is header field of binary data remains the same as that 
before connection of meta-data, if binary data is, e.g., 
Image data, an image can be reproduced by a conven- 
tional browser (connected meta-data is ignored). 
[0050] Furthermore, since meta-data is described 

20 in XML, if a tool that can interpret XML data is available, 
meta-data can be added, changed, and referred to, 
when the XML data contents are extracted, thus assur- 
ing very high compatibility. Note that extraction of meta- 
data contents described in XML will be described in 

25 detail in the second embodiment. 

[0051] Also, according to the first embodiment, new 
meta-data can be registered in data in which another 
meta-data has already been registered, without discard- 
ing the existing meta-data. For this reason, binary data 

30 registered with a plurality of meta-data and binary data 
having the history of meta-data can be generated. 
[0052] In the description of the process for register- 
ing meta-data by replacing It, when one existing meta- 
data is present, new meta-data is registered by replac- 

35 ing that existing meta-data (Rg. 4). However, according 
to this embodiment, when meta-data is additionally reg- 
istered, a plurality of meta-data can be registered in 
binary data. In this manner, when a plurality of meta- 
data are present, and new meta-data is registered by 

40 "replace" or "add", various patterns are available. 

[0053] For example, Rg. 5 shows a state wherein 
three meta-data (meta-data A, B, and C) are registered. 
In such case, when new meta-data is registered by 
replacing existing data, the following processes can be 

45 done. 

(1) All existing meta-data (meta-data A to C) are 
deleted, and new meta-data is connected to the 
end of binary data (new meta-data replaces all 

so existing meta-data). 

(2) One or a plurality of desired meta-data are des- 
ignated and deleted, the remaining meta-data 
are/is moved to the end of binary data, and new 
meta-data is connected to the end of that data. 

55 (3) One desired meta-data is designated and 
deleted, and new meta-data is inserted into that 
position (new meta-data replaces desired one exist- 
ing meta-data). 
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[0054] The aforementioned processes can be 
implemented using a known data edit technique as long 
as each meta-data can be extracted. As will be 
described later with reference to Fig. 7, even when a 
plurality of meta-data are registered in binary data, 5 
since each meta-data can be extracted, desired meta- 
data can be deleted or meta-data can be inserted in a 
desired order by a known data edit process, thus imple- 
menting various processes including (1) to (3) men- 
tioned above. 10 
[0055] Of course, when new meta-data is addition- 
ally registered, it can be inserted at the end of binary 
data (before the existing meta-data). 

[Second Embodiment] is 

[0056] In the first embodiment, the method of regis- 
tering meta-data in binary data has been explained. In 
the second embodiment, a process for discriminating 
whether or not meta-data is registered in binary data, 20 
and extracting the meta-data or displaying the history of 
registered meta-data if it is registered will be explained. 
Note that the arrangement of the data processing appa- 
ratus in the second embodiment is the same as that in 
the first embodiment (Fig. 1), and a detailed description 25 
thereof will be omitted. 

[0057] The processes for discriminating whether or 
not meta-data that has been explained in the first 
embodiment is registered in data of a designated file, 
and extracting the registered meta-data will be 30 
explained below. Fig. 6 is a flow chart showing the dis- 
crimination/extraction sequence of registered meta- 
data according to the second embodiment. In this 
embodiment, the extracted meta-data is displayed on 
the display 103, but the present invention is not limited 35 
to such specific output mode. For example, it is known 
to those who are skilled in the art that the extracted 
meta-data may be provided to a search or edit process. 
[0058] Fig. 8 shows an example of the data struc- 
ture of binary data in which XML data are registered as 40 
meta-data. As has been explained in the first embodi- 
ment, the data structure In which a plurality of meta-data 
(XML data) are registered is as shown in Fig. 8. Rg. 8 
shows a state wherein three meta-data (described in 
XML) are registered in binary data (composed of a 45 
header and data). That is, Rg. 8 shows a state wherein 
three meta-data are connected in turn by executing the 
meta-data "add" process described in the first embodi- 
ment three times. 

[0059] In the process shown In Rg. 6, the presence so 
of meta-data is checked in data with the structure men- 
tioned above, meta-data are extracted in turn from end 
one, and their contents are displayed. 
[0060] A file which is to undergo discrimination as 
to whether or not meta-data Is registered is designated 55 
by a user instruction in step S501. The file to be proc- 
essed (data to be processed) is designated in step 
S501 by inputting the file name of the data to be proc- 



10 

essed at the keyboard or Indicating a corresponding 
Icon using the pointing device (mouse). 
[0061] It is discriminated in step S502 If meta-data 
described In XML is registered in data to be processed 
of the designated file. Details of the discrimination proc- 
ess in step S502 will be explained below with reference 
to the flow chart in Fig. 7. Rg. 7 is a flow chart for 
explaining details of the meta-data discrimination proc- 
ess according to the second embodiment 
[0062] As shown in Fig. 7, the entire data of the file 
designated in step S501 is loaded onto the memory 
(RAM 106) in step S601. Since the data output In step 
S307 in the first embodiment is managed as a single 
file, the entire data can be read out by a general file 
management system. 

[0063] It is checked in step S602 if a character 
string "(/PhotoXML)' is present at the end of the data to 
be processed loaded in step S601. If such character 
string is not present, the flow advances to step S605. 
[0064] On the other hand, if the character string 
"(/PhotoXML)" is present at the end of the loaded data to 
be processed, the flow advances to step S603. It is 
checked in step S603 if a character string "(PhotoXML/ 
is present before the character string "(/PhotoXML)", 
and it is also confirmed if data bounded by these char- 
acter strings is described In a correct XML format. At 
this time, it may be further checked if that data is correct 
XML data. Whether or not the data has a correct format 
and is correct can be discriminated, as has been 
explained in the first embodiment (step S303). 
[0065] If it is confirmed in step S603 that the data 
has a correct format, the flow advances to step S604. It 
Is concluded in step S604 that meta-data is registered, 
and this process ends. On the other hand, if a correct 
format is not confirmed in step S603, the flow advances 
to step S605. It is concluded in step S605 that meta- 
data is not registered. That is, If it is determined In step 
S602 that the character string "(/PhotoXML)" is not 
present at the end of the binary data of interest, if ft is 
determined in step S603 that the character string "(Pho- 
toXML)' 1 is not present, or if it is determined in step S603 
that described contents bounded by the character 
strings are incorrect, the flow advances to step S605 to 
determine that no meta-data is registered in the data to 
be processed. 

[0066] In this manner, discrimination of meta-data 
ends. 

[0067] Referring back to the flow chart in Rg. 6, if it 
is determined by the discrimination process shown in 
Fig. 7 that meta-data is not registered, this processing 
ends (S502). On the other hand, If it Is determined that 
meta-data is registered, the flow advances from step 
S502 to step S503. in step S503, the meta-data which 
is determined to have a correct format in step S603 
above (XML data bounded by "(PhotoXML)" and "(/Pho- 
toXML)") is extracted and its contents are displayed on 
the display 103. Then, the meta-data which is extracted 
in step S603 and displayed in step S504 is separated 
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from the data of Interest, and the remaining data Is 
stored in the memory (RAM 106). After that, the flow 
returns to step S502, and the aforementioned proc- 
esses repeat themselves for the remaining data. With 
the aforementioned processes, in Fig. 8 XML data C is 5 
separated, and steps S502 to S504 repeat themselves 
for the remaining data. As a result, XML data B is then 
extracted and displayed, and after that, XML data A is 
extracted and displayed. 

[0088] By repeating the aforementioned process- 10 
ing, if no meta-data is registered, no data is displayed. 
But If meta-data are registered, all registered meta-data 
are displayed. When a plurality of meta-data are regis- 
tered, meta-data are displayed in turn from the latest 
registered one. 15 
[0069] As described above, according to the sec- 
ond embodiment, binary data with meta-data, and nor- 
mal binary data can be discriminated by checking if 
XML data is described at the end of data In a correct for- 
mat. If meta-data is found, that meta-data can be dis- 20 
played. 

[0070] More specifically, according to the second 
embodiment, binary data registered with meta-data can 
be discriminated from that registered with no meta-data, 
and the registered meta-data can be extracted. There- 25 
fore, when an existing data description language is used 
as that for describing meta-data, existing tools of that 
data description language can be used in a search 
process using meta-data, thus saving extra efforts for 
development. 30 
[0071] Furthermore, when a plurality of meta-data 
are registered, all these meta-data can be extracted and 
displayed one by one. Since a plurality of meta-data are 
registered time-serially, the history of meta-data can be 
presented to the user by extracting them in turn from the 35 
latest one. Or the updating date data may be described 
in meta-data, and the display order may be controlled in 
accordance with the description of the dates. In view of 
history display, only the updating date may be extracted 
from the meta-data extracted In step S503, and may be 40 
displayed. 

[0072] In the above embodiment, when a plurality of 
meta-data are registered, all meta-data are output. 
Alternatively, one or a plurality of those meta-data may 
be selectively presented. For example, only the latest 45 
registered meta-data may be displayed. Or mufti-lingual 
meta-data including a plurality of meta-data in different 
natural languages may be registered, and only meta- 
data in a desired language may be extracted. To imple- 
ment such process, the following process can be added, so 
That Is, it is checked between steps S502 and S503 it 
the registered meta-data matches an extraction condi- 
tion (language type or the like). If the meta-data 
matches the extraction condition, the flow advances to 
step S503; otherwise, the flow advances to step S504. 55 
[0073] As can be seen from the descriptions of the 
first and second embodiments, according to the present 
invention, meta-data can be registered in binary data 
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without any influences on existing applications. That Is, 
binary data registered with meta-data can be provided 
in a format that can be processed by an existing appli- 
cation. 

[0074] Also, according to the present invention, If 
meta-data has already been registered, new meta-data 
can be additionally registered while saving the existing 
meta-data. 

[0075] Furthermore, according to the present inven- 
tion, when a plurality of meta-data are registered, the 
history of meta-data can be presented. 

[Third Embodiment] 

[0076] In the descriptions of the first and second 
embodiments, when meta-data has already been 
present in binary data, new meta-data is registered by 
the "add" or "replace" process, and meta-data are 
extracted from binary data including a plurality of meta- 
data obtained in this manner. In the third embodiment, a 
data processing apparatus which can Join binary data 
having meta-data will be explained. Note that the 
arrangement of the data processing apparatus in the 
third embodiment is the same as that in the first embod- 
iment (Fig. 1), and a detailed description thereof wilt be 
omitted. 

[0077] The process for registering meta-data in 
binary data in the data processing apparatus of the third 
embodiment will be explained below. Fig. 9 is a flow 
chart for explaining a meta-data registration process 
according to this embodiment. 
[0078] Referring to Fig. 9, binary data designated 
by the user is loaded onto the memory (RAM 106) in 
step S1101. In this case, the binary data is designated 
by inputting a desired binary data file name at the key- 
board, or pointing to an icon of the corresponding binary 
data using the pointing device (e.g., a mouse). In step 
S1 102, an XML file which is designated by the user and 
describes meta-data is loaded onto the memory (RAM 
106). This XML file is also designated by inputting a file 
name at the keyboard or pointing to the corresponding 
icon by the pointing device (e.g., a mouse). 
[0079] It is checked in step S1103 if the XML file 
that describes meta-data Is XML data in a correct for- 
mat. The correct format is discriminated by checking if 
the description format of an XML file is satisfied (e.g., if 
the opening and closing parentheses of tags correctly 
match, if a tag assignment format Is correct, and so 
forth). Note that it is also checked If XML data is correct 
as well as if it has a correct format Whether or not XML 
data is correct can be determined by checking, e.g., If 
XML data is described in accordance with a schema 
such as DTD (Document Type Definition) or the like. 
[0080] If it Is determined in step S 11 03 that the XML 
file is not XML data in the correct format, the flow 
advances to step S1105. In step S1105, an XML data 
error is displayed on the display 103, thus ending this 
process. 
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[0081] On the other hand, If It Is determined In step 
S1 1 03 that the XML file is XML data In the correct for- 
mat, the flow advances to step S1104. In step S1 104, 
meta-data is registered by connecting that meta-data to 
the end of the binary data loaded onto the memory in 
step S1101. After that, the binary data registered with 
the meta-data is output in step S1 1 06, thus ending the 
processing. Note that data having a data structure 
shown in Fig. 10 is stored as one file in the storage unit 
102 upon outputting data in step S1 106. 
[0082] Fig. 1 0 Is a view for explain ing the registered 
state of meta-data in binary data according to this 
embodiment. As shown in Fig. 1 0, by connecting meta- 
data described in XML data to the end of binary data, 
meta-data can be registered without any influences on 
other applications. More specifically, since information 
in the header field of binary data remains the same as 
that before connection of meta-data, if binary data is, 
e.g., image data, an image can be reproduced by a con- 
ventional browser (connected meta-data is Ignored). 
[0083] Furthermore, since meta-data is described 
in XML, if a tool that can interpret XML data is available, 
meta-data can be added, changed, and referred to, 
when the XML data contents are extracted, thus assur- 
ing very high compatibility. Note that the XML data con- 
tents can be extracted as meta-data by searching for 
tags (/PhotoXML) and (PhotoXML) from the end of data, 
and checking XML correctness of the data bounded by 
these tags. 

[0084] The process for synthesizing a plurality of 
data, and registering meta-data by combining individual 
meta-data will be explained below with reference to the 
flow chart shown In Fig. 1 1 . Fig. 1 1 is a flow chart for 
explaining the sequence for synthesizing a plurality of 
data according to this embodiment As will be described 
below, in this embodiment, when data to be synthesized 
are appended with meta-data, meta-data are rear- 
ranged, and are registered in the synthesized data. 
[0085] Referring to Fig. 1 1 , data 1 and data 2 which 
are to undergo a synthesis process are loaded onto the 
memory in accordance with a user instruction in step 
S1301. It is checked in step S1302 if meta-data are 
appended to loaded data 1 and 2. If meta-data are 
appended, the flow advances to step S1303; otherwise, 
the flow advances to step S1 307. 
[0086] As described above, the data to be proc- 
essed registered with XML data as meta-data has a 
data structure as shown in Fig. 3. Therefore, the pres- 
ence/absence of meta-data can be discriminated in the 
sequence mentioned above with reference to Fig. 7. 
The process explained in Fig. 7 is individually done for 
data 1 and 2 to check the presence/absence of meta- 
data. 

[0087] If it is determined in step S1302 that meta- 
data are appended, data 1 is segmented into binary 
data 1 and meta-data 1 , and also data 2 Into binary data 
2 and meta-data 2 in step S1303. The flow then 
advances to step S1304. In step S1304, binary data 1 
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and 2 are synthesized. 

[0088] Fig. 12 shows the operations in steps S1303 
and S1304. That Is, meta-data which are determined to 
be registered in the discrimination sequence shown in 

5 Fig. 7 are respectively separated as meta-data 1 and 2 
from data 1 and 2. The remaining data after the meta- 
data are separated are binary data 1 and 2. The 
obtained binary data 1 and 2 are synthesized to gener- 
ate synthesized binary data. Note that synthesis is to 

10 generate a new image by superposing individual 
images or using portions of individual images when 
data are image data. 

[0069] If It is determined in step S1305 that the 
appended meta-data are described in a correct XML 

15 format, the flow advances to step S1306 to arrange 
meta-data 1 and 2 in the order of date, and connect 
them to the binary data synthesized In step S1304. 
[0090] In this case, since whether or not the meta- 
data has a correct format has already been dlscrimi- 

20 nated in step S603 in Fig. 7, step S1305 can use the 
discrimination result. However, if the correct format is 
not discriminated in step S603, that discrimination is 
made in step S1305. 

[0091 ] Fig. 1 3 is a view for explaining the process in 

25 step S1306. As described above, meta-data 1 sepa- 
rated from data 1 and meta-data 2 separated from data 
2 are rearranged in the order of date. The rearranged 
meta-data are connected to the end of the binary data 
synthesized in step S1304. 

30 [0092] On the other hand, if meta-data are not XML 
data in a correct format, meta-data 1 and 2 are not con- 
nected to the synthesized binary data, and the flow 
advances to step S1308. On the other hand, if no meta- 
data Is found In the data In step S1302, data 1 and 2 are 

35 synthesized In step S1307. After that, the synthesized 
data Is output as one file in step S1 308. 
[0093] With the above-mentioned processes, even 
when data 1 and 2 may or may not include meta-data, 
they can be synthesized. When meta-data described fn 

40 a correct XML format are found, they can be connected 
to the binary data In the order of date. 
[0094] More specifically, data including binary data 
and meta-data can be synthesized, and meta-data can 
be rearranged in, e.g., the order of date. Furthermore, 

45 since meta-data is described in XML, if a tool that can 
interpret XML data Is available, meta-data can be 
added, changed, and referred to, thus assuring very 
high compatibility. 

[0095] Note that discrimination of the correct format 
so of XML data in step S1 305 includes that of correct XML 
data. 

[0096] In this embodiment, meta-data are rear- 
ranged in the date order, but may be rearranged based 
on other elements contained in the meta-data. The way 
55 meta-data are rearranged may be interactively deter- 
mined by the user. When the meta-data are interactively 
rearranged, separated meta-data may be displayed, 
and the user may designate meta-data to be described 
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and their connection order. 

[0097] In the above embodiment, the process for 
synthesizing two data has been explained. However, it 
is known to those who are skilled in the art that the proc- 
ess of this embodiment can be applied to synthesis of 5 
three or more data. When one data contains meta-data, 
and the other does not contain any meta-data, meta- 
data may be connected to the end of the synthesized 
binary data without synthesizing meta-data. 
[0098] In the above embodiment, new meta-data is 10 
formed by arranging a plurality of separated meta-data 
in the order of date. Alternatively, meta-data to be con- 
nected to the synthesized binary data may be formed 
using data selected from a plurality of separated meta- 
data. For example, meta-data may be reconstructed 15 
using the latest one of a plurality of separated meta- 
data. Or, a predetermined number of meta-data may be 
selected in descending order of date. 
[0099] Furthermore, data commonly contained in 
all of a plurality of separated meta-data may be 20 
extracted, and new meta-data may be generated using 
the extracted data. In this case, since the AND contents 
of a plurality of meta-data are left as meta-data, the 
meta-data size can be reduced, I.e., the total data size 
can be reduced. Note that the method of generating 25 
meta-data is not limited to such specific method. For 
example, the OR contents of meta-data may be left For 
example, when one meta-data describes "sea" and 
"dolphin", and the other meta-data describes "sea", one 
of the overlapping "sea" data is deleted, and the meta- 30 
data generated as a result contains "sea" and "dolphin". 
In this manner, information descrtoed in each meta-data 
can be prevented from being lost, and identical data can 
be prevented from being repetitively described. 
[0100] Also, the order of a plurality of meta-data 35 
may be re-determined on the basis of information 
described in a plurality of separated meta-data. For 
example, a category of importance may be assigned to 
each meta-data using a numerical value, and the order 
of meta-data may be determined in accordance with 40 
numerical values described in their categories of impor- 
tance. 

[0101] As described above, according to this 
embodiment, when data in each of which meta-data 
described in XML is joined to the end of binary data are 45 
synthesized, binary data can be synthesized by sepa- 
rating and rearranging meta-data. 
[0102] Note that the processing described in the 
second embodiment can be applied to extract meta- 
data from the synthesized binary data including meta- so 
data. 

[0103] As can be seen from the description of the 
third embodiment, according to the present invention, 
meta-data can be registered in binary data without 
exerting any influences on existing applications. 55 
[0104] Also, according to the present Invention, 
upon describing new meta-data in binary data gener- 
ated by synthesizing a plurality of binary data, existing 



meta-data can be effectively used. That is, data In which 
meta-data have already been registered are synthe- 
sized can be synthesized without registering new meta- 
data 

[0105] Furthermore, when meta-data is described 
in an existing data description language, existing tools 
of that data description language can be used, thus sav- 
ing extra efforts for development. 
[0106] According to the present invention, when 
meta-data have already been registered in a plurality of 
binary data to be synthesized, existing meta-data can 
be selectively used in synthesized binary data depend- 
ing on purposes. 

[0107] Aocording to the present invention, when 
meta-data have already been registered in a plurality of 
binary data to be synthesized, only data contained in all 
meta-data can be described. 

[Fourth Embodiment] 

[01 06] The fourth embodiment will explain an appli- 
cation example of binary data including meta-data. In 
the fourth embodiment, meta-data including a descrip- 
tion that associates a plurality of binary data is gener- 
ated, and is appended to each of these binary data. 
More specifically, the locations of associated binary 
data are described In meta-data. Note that the arrange- 
ment of the data processing apparatus in the fourth 
embodiment is the same as that in the first embodiment 
(Fig. 1), and a detailed description thereof will be omit- 
ted. 

[01 09] The sequence for appending meta-data that 
describes the locations of a plurality of binary data to 
these binary data will be explained below with reference 
to the flowchart In Fig. 14. In the fourth embodiment, by 
designating a plurality of binary data to be associated, 
meta-data indicating the locations of these binary data 
Is appended to each binary data. 
[01 10] Referring to Fig. 1 4, n binary data are desig- 
nated by a user instruction in step S2301 . Various meth- 
ods of designating n binary data may be used. For 
example, a dialog or the like may be displayed, and a 
plurality of data may be designated. Alternatively, after n 
binary data are selected, they may be dragged and 
dropped onto a predetermined location. In step S2302, 
location information is extracted from the n binary data. 
The location information includes a URL such as 
"httpV/www.abcdef. co.jp/images/19990427/001 Jpg", an 
absolute path such as 

,, c:¥My_Pictures¥1 999lmage¥hana.jpg 1, I or location 
Information using an ID or the like. In step S2303, the 
extracted location information is described on the mem- 
ory in a correct format using correct XML, thus generat- 
ing meta-data. 

[01 11] Fig. 1 6 shows an example of the description 
contents of the meta-data generated in step S2303. 
Character strings bounded by <PICPATH> and (/PIC- 
PATH) Indicate the locations of binary data (image data 
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files), and in the example shown in Fig. 16, the locations 
of three Images are described using URLs. 
[0112] In step S2304, the location Information (= 
meta-data) described in correct XML on the memory Is 
joined to each binary data. A method of joining meta- 
data described in a correct XML format to n binary data 
will be described below with reference to the flow chart 
shown in Fig. 15. 

[0113] Fig. 15 is a flow chart for explaining the 
sequence for joining meta-data to binary data to be 
processed. In step S2401 , "0" is set In counter i. In step 
S2402, the meta-data generated in step S2303 is joined 
to the i-th binary data. In this case, the meta-data is 
joined to the end of image data. The method of joining 
meta-data to binary data such as image data is as has 
been explained in the first and third embodiments 
above. Note that Fig. 17 shows an example in which the 
meta-data shown in Fig. 16 (meta-data generated in 
step S2304) is joined to binary data (image data). 
[0114] In step S2403, counter i is incremented by 1 . 
In step S2404, the aforementioned processes in steps 
S2402 and S2403 are repeated for n binary data. 
[0115] With the aforementioned processing, binary 
data (image data) are associated, as shown in Fig. 18. 
In this example, since three image data files (01.jpg, 
02.jpg, and 03.jpg) are designated, as shown in Fig. 16, 
these image data files are associated with each other by 
the meta-data. 

[0116] As described above, according to the fourth 
embodiment, since meta-data that describes the loca- 
tions of a plurality of binary data in XML is generated, 
and is joined to the end of each binary data, if only one 
binary data is available, the locations of a plurality of 
binary data associated with that binary data can be con- 
firmed. As described In the first to third embodiments, 
since meta-data is connected to the end of binary data, 
binary data can be reproduced using an existing 
browser. 

[Fifth Embodiment] 

[01 17] In the fourth embodiment, the method of reg- 
istering meta-data that describes the locations of a plu- 
rality of binary data in binary data has been explained. 
In the fifth embodiment, processes for checking if meta- 
data is registered in Image data, extracting and analyz- 
ing the meta-data if it is registered, and displaying 
image data described in the registered meta-data will 
be explained. In the fifth embodiment, image files are 
loaded on the basis of the analysis result of meta-data, 
and the loaded images are displayed. However, thumb- 
nails may be generated using the locations of such 
images, or a new page composed of a plurality of 
images may be described. Also, audio data and moving 
image data may be used in place of image data. In such 
case, the playback method is changed in correspond- 
ence with the formats of those data. 
[0118] Note that the arrangement of the data 



processing apparatus in the fifth embodiment is the 
same as that in the fourth embodiment (Fig. 1), and a 
detailed description thereof will be omitted. 
[0119] The processes for checking the pres- 

s ence/absence of meta-data that describes the locations 
of Image data, which has been explained in the fourth 
embodiment, in a designated file, extracting the regis- 
tered meta-data, and confirming the locations of a plu- 
rality of image data will be explained. Fig. 19 is a flow 

io chart showing the discrimination/extraction sequence of 
registered meta-data according to the fifth embodiment 
[0120] Referring to Fig. 19, image data which is to 
undergo discrimination as to whether or not meta-data 
is registered is designated by a user instruction in step 

is S2601. It Is discriminated In step S2802 if meta-data 
described in XML is registered in the image data. 
Details of the discrimination process in step S2802 are 
as has been explained using the flow chart in Fig. 7 
(second embodiment). 

20 [0121] More specifically, in the fifth embodiment, 
the contents of image data registered with meta-data 
are as shown In Fig. 17. Therefore, the pres- 
ence/absence of meta-data Is discriminated as follows. 
That is, the entire image data is loaded onto the mem- 

25 ory (step S601), and It Is checked if a character string 
"(/PhotoXML)" is present at the end of the loaded Image 
data (step S602). If such character string is present, it is 
checked if a character string "(PhotoXML)" is present 
before the character string "(/PhotoXML)", and It Is also 

30 confirmed If meta-data bounded by these character 
strings is described in a correct XML format (step 
S603). If it is confirmed that the data has a correct for- 
mat, It Is concluded that meta-data is registered, and 
this process ends (step S604). On the other hand, If no 

35 VPhotoXML)" is present, if no "(PhotoXML)" is present, 
or if the description bounded by "{PhotoXML)" and 
"(/PhotoXML)" is incorrect, it is concluded that meta- 
data is not registered, thus ending this process (step 
S605). 

40 [0122] In this manner, if it is determined that meta- 
data is registered, the flow advances from step S2802 
to step S2803. On the other hand, if It is determined that 
no meta-data is registered, the processing ends. In step 
S2803, the contents of the registered meta-data are 

45 analyzed. Details of the analysis method will be 
explained below using the flow chart in Fig. 20. 
[0123] Referring to Fig. 20, the registered meta- 
data contents are extracted in step S2901 . It is checked 
in step S2902 If data bounded by "(PICTURE)" and 

so "(/PICTURE)" is present in the meta-data extracted. If 
such data is found, the flow advances to step S2903. It 
is checked in step S2903 If data bounded by "<PIC- 
PATH>° and VPICPATH)" Is present In the data string 
bounded by "(PICTURE)" and "(/PICTURE)". If such data 

55 is found, the flow advances to step S2904. In step 
S2904, since the data bounded by "(PICPATH)" and 
VPICPATH)" represents the location of each image data 
file, an image data file Is acquired In accordance with 
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that data, and the acquired Image is displayed on the 
display 103. In this embodiment, since an URL is 
described between "(PICPATH)" and VPICPATH)", an 
image data file is acquired according to that URL. 
[0124] On the other hand, if no data bounded by s 
"(PICTURE)" and V PICTURE)- Is found In step S2902, 
or if no data bounded by "(PICPATH)" and VPICPATH)" 
is found in step S2903, this process ends. 
[0125] With the aforementioned processes, the 
locations of a plurality of images can be detected from a 10 
single Image. In this embodiment, the location of each 
image is described using a URL, but may be described 
using a URN, ID, image path name, or the like. 
[0126] As described above, according to the fifth 
embodiment, by designating only an image file to which is 
meta-data indicating the locations of a plurality of image 
files is joined, a set of image data can be detected. More 
specifically, by designating only one file in an album, the 
contents of the album can be restored. 
[0127] As can be seen from the descriptions of the 20 
fourth and fifth embodiments, when location information 
of each of a plurality of binary data is described as 
meta-data in a data description language, and that 
meta-data is joined to the end of each binary data, a 
plurality of binary data can be associated without requir- 25 
ing any link format file or a huge file having a format 
unique to a given application. 
[0128] Also, according to the present invention, a 
set of a plurality of binary data can be detected from sin- 
gle binary data. Hence, each binary data can be nan- 30 
died as it is. 

[0129] Furthermore, binary data registered with 
meta-data can be discriminated from normal binary 
data. Moreover, as for binary data in which a plurality of 
meta-data are registered, dedicated tools of an existing 35 
data description language can be used without any 
modifications upon registration or search of meta-data, 
thus saving extra efforts for development. 
[0130] In addition, since meta-data contents can be 
easily separated, they can be used as a link format file. 40 
[0131] In the above embodiments, XML data is 
used as meta-data. However, the present invention is 
not limited to such specific data. For example, other 
data description languages such as SGML, HTML, and 
the like may be used. Also, stilt image data, moving 45 
image data, audio data, and the like can be used as 
binary data. 

[0132] Note that the present Invention may be 
applied to either a system constituted by a plurality of 
devices (e.g., a host computer, an Interface device, a so 
reader, a printer, and the like), or an apparatus consist- 
ing of a single equipment (e.g., a copying machine, a 
facsimile apparatus, or the like). 
[0133] The objects of the present Invention are also 
achieved by supplying a storage medium, which stores ss 
a program code of a software program that can Imple- 
ment the functions of the above-mentioned embodi- 
ments to the system or apparatus, and reading out and 



executing the program code stored In the storage 
medium by a computer (or a CPU or MPU) of the sys- 
tem or apparatus. 

[0134] In this case, the program code itsetf read out 
from the storage medium implements the functions of 
the above-mentioned embodiments, and the storage 
medium which stores the program code constitutes the 
present invention. 

[0135] As the storage medium for supplying the 
program code, for example, a floppy disk, hard disk, 
optical disk, magneto-optical disk, CD-ROM, CD-R, 
magnetic tape, nonvolatile memory card, ROM, and the 
like may be used. 

[0136] The functions of the above-mentioned 
embodiments may be implemented not only by execut- 
ing the readout program code by the computer but also 
by some or all of actual processing operations executed 
by an OS (operating system) running on the computer 
on the basis of an instruction of the program code. 
[0137] Furthermore, the functions of the above- 
mentioned embodiments may be imptemented by some 
or all of actual processing operations executed by a 
CPU or the like arranged in a function extension board 
or a function extension unit, which is inserted in or con- 
nected to the computer, after the program code read out 
from the storage medium is written in a memory of the 
extension board or unit. 

[01 38] As many apparently widely different embodi- 
ments of the present invention can be made without 
departing from the spirit and scope thereof, It Is to be 
understood that the invention is not limited to the spe- 
cific embodiments thereof except as defined in the 
claims. 

[0139] Further, the computer program code can be 
obtained In electronic form for example by downloading 
the code over a network such as the Internet Thus in 
accordance with another aspect of the present invention 
there is provided an electrical signal carrying processor 
implementable instructions for controlling a processor to 
carry out the method as hereinbefore described. 

Claims 

1- A data processing method for appending meta-data 
to binary data, characterized by comprising: 

the acquisition step (S301, S302) of acquiring 
data to be processed including a binary data 
content and meta-data content, and meta-data 
to be appended to the binary data; 
the detection step (S303, S304) of detecting 
the meta-data content at an end of the data to 
be processed acquired in the acquisition step; 
and 

the connection step (S305, S401-S404) of 
connecting a new meta-data content generated 
on the basis of the meta-data content detected 
in the detection step, and the meta-data 
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acquired in the acquisition step to an end of the 
binary data content Included in the data to be 
processed. 

2. The method according to claim 1 , further compris- 
ing the output step of o inputting whole data 
obtained in the connection step as a single file. 

3. The method according to claim 1 , wherein the con- 
nection step includes the step of generating the 
new meta-data content by connecting the meta- 
data acquired in the acquisition step to an end of 
the meta-data content detected In the detection 
step. 

4. The method according to claim 1 , wherein the con- 
nection step includes the step of generating the 
new meta-data content by replacing at least one 
meta-data included in the meta-data content 
detected in the detection step by the meta-data 
acquired in the acquisition step. 

5. The method according to claim 1 , wherein the con- 
nection step can set an operation mode for inhibit- 
ing the connection step from being executed when 
the meta-data content is detected in the detection 
step. 

6. The method according to claim 1 , further compris- 
ing the judging step of Judging If the meta-data 
acquired in the acquisition step is described in a 
correct format in a predetermined data description 
language, and 

wherein the connection step Is executed 
when it is determined in the judging step that the 
meta-data is described in the correct format. 

7. The method according to claim 6, wherein the judg- 
ing step includes the step of also judging tf the 
meta-data satisfies correctness as the predeter- 
mined data description language. 

8. A data processing method for registering meta-data 
In binary data, characterized by comprising: 

the loading step (S1301) of loading a plurality 
of data to be processed; 
the detection step (S1302) of detecting meta- 
data contents connected to ends of the plurality 
of data to be processed loaded in the loading 
step; 

the separation step (S1 303) of separating each 
data to be processed into the meta-data con- 
tent detected in the detection step, and a binary 
data content; 

the first generation step (S1304) of generating 
a new binary data content by synthesizing the 
binary data contents separated in the separa- 



tion step; 

the second generation step (S1305) of gener- 
ating a new meta-data content by synthesizing 
the meta-data contents separated in the sepa- 
5 ration step; and 

the connection step (S1306) of connecting the 
new meta-data content to an end of the new 
binary data content. 

10 9. The method according to claim 8, further compris- 
ing the output step of outputting whole data 
obtained in the connection step as a single file. 

10. The method according to claim 8, wherein the 
is detection step comprises: 

the check step of checking if an end character 
string specified in a predetermined data 
description language is present at an end of 

20 the data to be processed; 

the search step of searching for a start charac- 
ter string specified in the predetermined data 
description language toward a head of the 
data, when the end character string is present; 

25 and 

the inspection step of inspecting if data 
between the start and end character strings 
has a correct format in the predetermined data 
description language, when the start character 

30 string is found in the search step, and 

a series of data between the start and end 
character strings are detected as the meta- 
data content when It is determined in the 
inspection step that the data has the correct 

35 format 

11. The method according to claim 10, wherein the 
inspection step includes the step of also inspecting 
if correctness as the predetermined data descrip- 

40 Hon language is satisfied. 

12. The method according to claim 8, wherein the sec- 
ond generation step includes the step of generating 
the new meta-data content by arranging the meta- 

45 data contents separated in the separation step in 
ascending order of date. 

13. The method according to claim 8; wherein the sec- 
ond generation step includes the step of generating 

so the new meta-data content using a meta-data con- 
tent selected from the meta-data contents sepa- 
rated in the separation step. 

1 4. The method according to daim 1 3, wherein the sec- 
55 ond generation step Includes the step of using a 

meta-data content with the latest date of the meta- 
data contents separated in the separation step in 
generation of the new meta-data content 
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15. The method according to claim 8, wherein the sec- 
ond generation step includes the step of extracting 
contents commonly included in ail the meta-data 
contents separated in the separation step, and gen- 
erating the new meta-data content using the 
extracted data. 

16. The method according to claim 8, wherein the sec- 
ond generation step includes the step of designat- 
ing an order according to which the meta-data 
contents separated in the separation step are con- 
nected, and generating the new meta-data content 
by connecting the meta-data contents in the desig- 
nated order. 

17. The method according to claim 8, wherein the sec- 
ond generation step includes the step of determin- 
ing an order according to which the meta-data 
contents separated in the separation step are con- 
nected on the basis of information included in the 
meta-data contents separated in the separation 
step, and generating the new meta-data content by 
connecting the meta-data contents in the deter- 
mined order. 

18. A data processing method for discriminating meta- 
data in data, characterized by comprising: 

the loading step (S501, S601) of loading data 
to be processed; 

the detection step (S502, S602-S605) of 
detecting a series of data described in a correct 
format of a predetermined data description lan- 
guage at an end of the data to be processed 
loaded in the loading step; 
the extraction step (S503) of extracting the 
series of data detected in the detection step as 
meta-data; and 

the control step (S504) of executing the detec- 
tion step and the extraction step by excluding 
the meta-data extracted in the extraction step 
from the data to be processed. 

19. The method according to. claim 18, wherein the 
control step Includes the step of repeating the 
extraction step and the detection step until a new 
series of data are ceased to be detected in the 
detection step. 

20. The method according to claim 1 8, further compris- 
ing the output step of outputting the meta-data 
extracted In the extraction step. 

21. The method according to claim 20, wherein the out- 
put step includes the step of displaying on the basis 
of the extracted meta-data 

22. The method according to claim 20, wherein the out- 



24 

put step includes the step of providing the extracted 
meta-data to a tool for processing the predeter- 
mined data description language. 

5 23. The method according to claim 20, wherein the out- 
put step Includes the step of selectively outputting 
meta-data in accordance with contents of the 
extracted meta-data. 

10 24. The method according to claim 18, wherein the 
detection step comprises: 

the check step of checking if an end character 
string specified in a predetermined data 
is description language is present at an end of 

the data to be processed; 
the search step of searching for a start charac- 
ter string specified in the predetermined data 
description language toward a head of the 
20 data, when the end character string is present; 

and 

the inspection step of inspecting if data 
between the start and end character strings 
has a correct format in the predetermined data 
25 description language, when the start character 

string is found in the search step, and 
when it is determined in the inspection step 
that the data between the start and end charac- 
ter strings has the correct format, the data is 
30 detected in the detection step as the series of 

data. 

25. The method according to claim 24, wherein the 
Inspection step Includes the step of also inspecting 

35 if correctness as the predetermined data descrip- 
tion language is satisfied. 

26. A data processing method characterized by com- 
prising: 

40 

the designation step (S2301) of designating a 
plurality of binary data; 

the generation step (S2302, S2303) of generat- 
ing meta-data including a description that 

45 specifies the plurality of binary data designated 

in the designation step; and 
the connection step (S2304, S2401-S2404) of 
connecting the meta-data generated in the 
generation step to an end of each of the plural- 

so ity of binary data. 

27. The method according to claim 26. wherein the 
description that specifies the plurality of binary data 
includes information indicating locations of the plu- 

55 ral'rty of binary data. 

28. The method according to claim 27, wherein the 
locations of the plurality of binary data are 
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expressed by descriptions of URL addresses. 

29. The method according to claim 27, wherein the 
locations of the plurality of binary data are 
expressed by descriptions of file paths. 

30. A data processing method for reproducing binary 
data, characterized by comprising: 

the designation step (S2801) of designating 
data to be processed including binary data to 
be reproduced; 

the detection step (S2602) of detecting a meta- 
data content at an end of the data to be proc- 
essed designated in the designation step; 
the acquisition step (S2803, S2901 -S2903) of 
acquiring specifying information that specifies 
binary data from the meta-data detected in the 
detection step; and 

the reproduction step (S2804, S2904)of acquir- 
ing and reproducing the binary data specified 
by the specifying information acquired in the 
acquisition step. 

31. The method according to claim 30, wherein the 
meta-data is described in a predetermined data 
description language, and 

the detection step Includes the step of detect- 
ing a content having a description format of the 
predetermined data description language at 
the end of the data to be processed as the 
meta-data content 

32. The method according to claim 31, wherein the 
acquisition step includes the step of acquiring a 
character string bounded by a pair of predeter- 
mined character strings as the specifying informa- 
tion in the meta-data detected in the detection step. 

33. The method according to claim 30, wherein the 
specifying information indicates a location of binary 
data. 

34. The method according to any one of claims 1 to 32, 
wherein the binary data is image data. 

35. The method according to any one of claims 1 to 32, 
wherein the binary data is audio data. 

36. The method according to any one of claims 1 to 32, 
wherein the binary data is moving image data. 

37. The method according to any one of claims 1 to 32, 
wherein the meta-data is described in XML. 

38. The method according to any one of claims 1 to 32, 
wherein the meta-data is described in SGML. 



39. The method according to any one of claims 1 to 32, 
wherein the meta-data Is described in HTML. 

A data processing apparatus for appending meta- 
data to binary data, characterized by comprising: 

acquisition means (S301, S302) for acquiring 
data to be processed including a binary data 
content and meta-data content, and meta-data 
to be appended to the binary data; 
detection means (S303, S304) for detecting the 
meta-data content at an end of the data to be 
processed acquired by said acquisition means; 
and 

connection means (S305, S401-S404) for 
connecting a new meta-data content generated 
on the basis of the meta-data content detected 
by said detection means, and the meta-data 
acquired by said acquisition means to an end 
of the binary data content included in the data 
to be processed. 

The apparatus according to claim 40, further com- 
prising output means for outputting whole data 
obtained by said connection means as a single file. 

The apparatus according to claim 40, wherein said 
connection means generates the new meta-data 
content by connecting the meta-data acquired by 
said acquisition means to an end of the meta-data 
content detected by said detection means. 

The apparatus according to claim 40, wherein said 
connection means generates the new meta-data 
content by replacing at least one meta-data 
included In the meta-data content detected by said 
detection means by the meta-data acquired by said 
acquisition means. 

The apparatus according to claim 40, wherein said 
connection means can set an operation mode for 
inhibiting said connection means from being exe- 
cuted when the mete-data content is detected by 
said detection means. 

Trie apparatus according to claim 40, further com- 
prising judging means for judging if the meta-data 
acquired by said acquisition means is described in 
a correct format in a predetermined data descrip- 
tion language, and 

wherein said connection means is executed 
when said judging means determines that the 
meta-data is described in the correct format 

The apparatus according to claim 45, wherein said 
judging means also judges if the meta-data satis- 
fies correctness as the predetermined data descrip- 
tion language. 
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47. A data processing apparatus for registering meta- 
data In binary data, characterized by comprising: 

loading means (S1 301 ) for loading a plurality of 
data to be processed; 

detection means (S1302) tor detecting meta- 
data contents connected to ends of the plurality 
of data to be processed loaded by said loading 
means; 

separation means (S1303) for separating each 
data to be processed into the meta-data con- 
tent detected by said detection means, and a 
binary data content; 

first generation means (S1 304) for generating a 
new binary data content by synthesizing the 
binary data contents separated by said separa- 
tion means; 

second generation means (S1305) for generat- 
ing a new meta-data content by synthesizing 
the meta-data contents separated by said sep- 
aration means; and 

connection means (S1306) for connecting the 
new meta-data content to an end of the new 
binary data content. 

48. The apparatus according to claim 47, further com- 
prising output means for outputting whole data 
obtained by said connection means as a single file. 

49. The apparatus according to claim 47, wherein said 
detection means comprises: 

check means for checking if an end character 
string specified In a predetermined data 
description language is present at an end of 
the data to be processed; 
search means for searching for a start charac- 
ter string specified in the predetermined data 
description language toward a head of the 
data, when the end character string is present; 
and 

inspection means for inspecting if data 
between the start and end character strings 
has a correct format in the predetermined data 
description language, when the start character 
string is found by said search means, and 
a series of data between the start and end 
character strings are detected as the meta- 
data content when said inspection means 
determines that the data has the correct for- 
mat. 

50. The apparatus according to claim 49, wherein said 
inspection means also inspects if correctness as 
the predetermined data description language is sat- 
isfied. 

51. The apparatus according to claim 47, wherein said 



second generation means generates the new meta- 
data content by arranging the meta-data contents 
separated by said separation means In ascending 
order of date. 

5 

52. The apparatus according to claim 47, wherein said 
second generation means generates the new meta- 
data content using a meta-data content selected 
from the meta-data contents separated by said sep- 
ta aration means. 

53. The apparatus according to claim 52, wherein said 
second generation means uses a meta-data con- 
tent with the latest date of the meta-data contents 

is separated by said separation means in generation 
of the new meta-data content. 

54. The apparatus according to claim 47, wherein said 
second generation means extracts contents com- 

20 monty included in all the meta-data contents sepa- 
rated by said separation means, and generates the 
new meta-data content using the extracted data. 

55. The apparatus according to claim 47, wherein said 
25 second generation means can designate an order 

according to which the meta-data contents sepa- 
rated by said separation means are connected, and 
generates the new meta-data content by connect- 
ing the meta-data contents in the designated order. 

30 

56. The apparatus according to claim 47, wherein said 
second generation means determines an order 
according to which the meta-data contents sepa- 
rated by said separation means are connected on 

35 the basis of information included in the meta-data 
contents separated by said separation means, and 
generates the new meta-data content by connect- 
ing the meta-data contents in the determined order. 

40 57. A data processing apparatus for discriminating 
meta-data in data, characterized by comprising: 

loading means (S501 , S601 ) for loading data to 
be processed; 

45 detection means (S502, S602-S605) for 

detecting a series of data described in a correct 
format of a predetermined data description lan- 
guage at an end of the data to be processed 
loaded by said loading means; 

so extraction means (S503) for extracting the 

series of data detected by said detection 
means as meta-data; and 
control means (S504) for executing said detec- 
tion means and said extraction means by 

55 excluding the meta-data extracted by said 

extraction means from the data to be proc- 
essed. 
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58. The apparatus according to claim 57, wherein said 
control means repeats said extraction means and 
said detection means until a new series of data are 
ceased to be detected by said detection means. 

59. The apparatus according to claim 57, further com- 
prising output means for outputting the mete-data 
extracted by said extraction means. 

60. The apparatus according to claim 59, wherein said 
output means displays on the basis of the extracted 
meta-data. 

61. The apparatus according to claim 59, wherein said 
output means provides the extracted meta-data to a 
tool for processing the predetermined data descrip- 
tion language. 

62. The apparatus according to claim 59, wherein said 
output means selectively outputs meta-data in 
accordance with contents of the extracted meta- 
data. 

63. The apparatus according to claim 57, wherein said 
detection means comprises: 

check means for checking if an end character 
string specified In a predetermined data 
description language is present at an end of 
the data to be processed; 
search means for searching for a start charac- 
ter string specified in the predetermined data 
description language toward a head of the 
data, when the end character string Is present; 
and 

inspection means for inspecting if data 
between the start and end character strings 
has a correct format in the predetermined data 
description language, when the start character 
string is found by said search means, and 
when said inspection means determines that 
the data between the start and end character 
strings has the correct format, the data is 
detected by said detection means as the series 
of data. 

64. The apparatus according to claim 63, wherein the 
inspection means also inspects if correctness as 
the predetermined data description language is sat- 
isfied. 

65. A data processing apparatus characterized by com- 
prising: 

designation means (S2301) for designating a 
plurality of binary data; 

generation means (S2302, S2303) for generat- 
ing meta-data including a description that 



specifies the plurality of binary data designated 
by said designation means; and 
connection means (S2304, S2401-S2404) for 
connecting the meta-data generated by said 
5 generation means to an end of each of the plu- 

rality of binary data. 

66. The apparatus according to claim 65, wherein the 
description that specifies the plurality of binary data 

10 includes information indicating locations of the plu- 
rality of binary data. 

67. The apparatus according to claim 66, wherein the 
locations of the plurality of binary data are 

75 expressed by descriptions of URL addresses. 

68. The apparatus according to claim 66, wherein the 
locations of the plurality of binary data are 
expressed by descriptions of file paths. 

20 

69. A data processing apparatus for reproducing binary 
data, characterized by comprising: 

designation means (S2801) for designating 
25 data to be processed including binary data to 

be reproduced; 

detection means (S2B02) for detecting a meta- 
data content at an end of the data to be proc- 
essed designated by said designation means; 
30 acquisition means (S2803, S2901~S2903) for 

acquiring specifying information that specifies 
binary data from the meta-data detected by 
said detection means; and 
reproduction means (S2804, S2904) for acquir- 
es ing and reproducing the binary data specified 
by the specifying information acquired by said 
acquisition means. 

70. The apparatus according to claim 69, wherein the 
40 meta-data is described in a predetermined data 

description language, and 

said detection means detects a content having 
a description format of the predetermined data 
45 description language at the end of the data to 

be processed as the meta-data content. 

71. The apparatus according to claim 70, wherein said 
acquisition means acquires a character string 

so bounded by a pair of predetermined character 
strings as the specifying information in the meta- 
data detected by said detection means. 

72. The apparatus according to claim 69, wherein the 
55 specifying Information indicates a location of binary 

data. 

73. The apparatus according to any one of claims 40 to 
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71 , wherein the binary data is Image data. 

74. The apparatus according to any one of claims 40 to 
71, wherein the binary data is audio data. 

75. The apparatus according to any one of claims 40 to 
71 , wherein the binary data is moving image data. 

76. The apparatus according to any one of claims 40 to 
71 , wherein the meta-data is described in XML. 

77. The apparatus according to any one of claims 40 to 
71 , wherein the meta-data is described in SGML 

78. The apparatus according to any one of claims 40 to 
71 , wherein the meta-data Is described In HTML. 

79. A storage medium for storing a control program 
which can be executed by a computer, said control 
program characterized by comprising: 

a code of the acquisition step of acquiring data 
to be processed including a binary data content 
and meta-data content, and meta-data to be 
appended to the binary data; 
a code of the detection step of detecting the 
meta-data content at an end of the data to be 
processed acquired in the acquisition step; and 
a code of the connection step of connecting a 
new meta-data content generated on the basis 
of the meta-data content detected in the detec- 
tion step, and the meta-data acquired In the 
acquisition step to an end of the binary data 
content included in the data to be processed. 

80. A storage medium for storing a control program 
which can be executed by a computer, said control 
program characterized by comprising: 

a code of the loading step of loading a plurality 
of data to be processed; 
a code of the detection step of detecting meta- 
data contents connected to ends of the plurality 
of data to be processed loaded in the loading 
step; 

a code of the separation step of separating 
each data to be processed into the meta-data 
content detected in the detection step, and a 
binary data content; 

a code of the first generation step of generating 
a new binary data content by synthesizing the 
binary data contents separated in the separa- 
tion step; 

a code of the second generation step of gener- 
ating a new meta-data content by synthesizing 
the meta-data contents separated in the sepa- 
ration step; and 

a code of the connection step of connecting the 



new meta-data content to an end of the new 
binary data content. 

81. A storage medium for storing a control program 
5 which can be executed by a computer, said control 

program characterized by comprising: 

a code of the loading step of loading data to be 
processed; 

to a code of the detection step of detecting a 

series of data described in a correct format of a 
predetermined data description language at an 
end of the data to be processed loaded in the 
loading step; 

is a code of the extraction step of extracting the 

series of data detected In the detection step as 
meta-data; and 

a code of the control step of executing the 
detection step and the extraction step by 
20 excluding the meta-data extracted in the 

extraction step from the data to be processed. 

82. A storage medium for storing a control program 
which can be executed by a computer, said control 

25 program characterized by comprising: 

a code of the designation step of designating a 
plurality of binary data; 

a code of the generation step of generating 
30 meta-data including a description that specifies 

the plurality of binary data designated in the 
designation step; and 

a code of the connection step of connecting the 
meta-data generated in the generation step to 
35 an end of each of the plurality of binary data. 

83. A storage medium for storing a control program 
which can be executed by a computer, said control 
program characterized by comprising: 

40 

a code of the designation step of designating 
data to be processed including binary data to 
be reproduced; 

a code of the detection step of detecting a 
45 meta-data content at an end of the data to be 

processed designated In the designation step; 
a code of the acquisition step of acquiring 
specifying Information that specifies binary 
data from the meta-data detected In the detec- 
50 tion step; and 

a code of the reproduction step of acquiring 
and reproducing the binary data specified by 
the specifying information acquired in the 
acquisition step. 

55 

84. A method of processing a data file comprising data 
and metadata wherein the metadata is not in a 
required format, the method comprising adding fur- 
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ther metadata in the required format. 

85. A computer program comprising processor imple- 
mentable instructions for carrying out a method as 
claimed in any one of claims 1 to 39 and 84. 5 

86. A signal carrying processor implementable Instruc- 
tions for carrying out a method as claimed in any 
one of claims 1 to 39 and B4. 
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